A LightGBM-Based EEG Analysis Method for Driver Mental States Classification

Fatigue driving can easily lead to road traffic accidents and bring great harm to individuals and families. Recently, electroencephalography- (EEG-) based physiological and brain activities for fatigue detection have been increasingly investigated. However, how to find an effective method or model to timely and efficiently detect the mental states of drivers still remains a challenge. In this paper, we combine common spatial pattern (CSP) and propose a light-weighted classifier, LightFD, which is based on gradient boosting framework for EEG mental states identification. ,e comparable results with traditional classifiers, such as support vector machine (SVM), convolutional neural network (CNN), gated recurrent unit (GRU), and large margin nearest neighbor (LMNN), show that the proposed model could achieve better classification performance, as well as the decision efficiency. Furthermore, we also test and validate that LightFD has better transfer learning performance in EEG classification of driver mental states. In summary, our proposed LightFD classifier has better performance in real-time EEG mental state prediction, and it is expected to have broad application prospects in practical brain-computer interaction (BCI)

Transfer Learning for Motor Imagery Based Brain-Computer Interfaces: A Complete Pipeline

Transfer learning (TL) has been widely used in motor imagery (MI) based brain-computer interfaces (BCIs) to reduce the calibration effort for a new subject, and demonstrated promising performance. While a closed-loop MI-based BCI system, after electroencephalogram (EEG) signal acquisition and temporal filtering, includes spatial filtering, feature engineering, and classification blocks before sending out the control signal to an external device, previous approaches only considered TL in one or two such components. This paper proposes that TL could be considered in all three components (spatial filtering, feature engineering, and classification) of MI-based BCIs. Furthermore, it is also very important to specifically add a data alignment component before spatial filtering to make the data from different subjects more consistent, and hence to facilitate subsequential TL. Offline calibration experiments on two MI datasets verified our proposal. Especially, integrating data alignment and sophisticated TL approaches can significantly improve the classification performance, and hence greatly reduces the calibration effort

EEG Fingerprints: Phase Synchronization of EEG Signals as Biomarker for Subject Identification

The goal of biometrics is to recognize humans based on their physical and behavioral characteristics. Preliminary studies have demonstrated that the electroencephalogram(EEG) is potentially more secure and private than traditional biometric identifiers. At present, the EEG identification method targets specific tasks and cannot be generalized. In this study, a novel EEG-based biometric identification method that extracts the phase synchronization (PS) features for subject identification is proposed under a variety of tasks. We quantified the PS features by the phase locking value (PLV) in different frequency bands. Subsequently, we employed the principal component analysis (PCA) to reduce the dimension. Then, we used the linear discriminant analysis (LDA) to construct a projection space and projected the features onto the projection space. Finally, a feature vector was assigned to the class label. The experimental results of the proposed method used on 3 datasets with different cognitive tasks showed high classification accuracies and relatively good stabilities. From the results, we found that particularly in the beta and gamma bands, the average accuracies are more than 97% with the standard deviation equal to or less than the magnitude 10e-2 for both Dataset 1 and Dataset 2. For Dataset 3, the PS feature vectors in all off the bands have high classification accuracies, which are more than 97% with the standard deviation of the same magnitude. Our work demonstrated that the phase synchronization of EEG signals has task-free biometric properties, which can be used for subject identification

Cross-session Emotion Recognition by Joint Label-common and Label-specific EEG Features Exploration

Since Electroencephalogram (EEG) is resistant to camouflage, it has been a reliable data source for objective emotion recognition. EEG is naturally multi-rhythm and multi-channel, based on which we can extract multiple features for further processing. In EEG-based emotion recognition, it is important to investigate whether there exist some common features shared by different emotional states, and the specific features associated with each emotional state. However, such fundamental problem is ignored by most of the existing studies. To this end, we propose a Joint label-Common and label-Specific Features Exploration (JCSFE) model for semi-supervised cross-session EEG emotion recognition in this paper. To be specific, JCSFE imposes the ℓ 2,1 -norm on the projection matrix to explore the label-common EEG features and simultaneously the ℓ 1 -norm is used to explore the label-specific EEG features. Besides, a graph regularization term is introduced to enforce the data local invariance property, i.e ., similar EEG samples are encouraged to have the same emotional state. Results obtained from the SEED-IV and SEED-V emotional data sets experimentally demonstrate that JCSFE not only achieves superior emotion recognition performance in comparison with the state-of-the-art models but also provides us with a quantitative method to identify the label-common and label-specific EEG features in emotion recognition

Attention allocation on mobile app interfaces when human interacts with them

With the popularity of smartphones and the pervasion of mobile apps, people spend more and more time to interact with a diversity of apps on their smartphones, especially for young population. This raises a question: how people allocate attention to interfaces of apps during using them. To address this question, we, in this study, designed an experiment with two sessions (i.e., Session1: browsing original interfaces; Session 2: browsing interfaces after removal of colors and background) integrating with an eyetracking system. Attention fixation durations were recorded by an eye-tracker while participants browsed app interfaces. The whole screen of smartphone was divided into four even regions to explore fixation durations. The results revealed that participants gave significantly longer total fixation duration on the bottom left region compared to other regions in the session (1) Longer total fixation duration on the bottom was preserved, but there is no significant difference between left side and right side in the session2. Similar to the finding of total fixation duration, first fixation duration is also predominantly paid on the bottom area of the interface. Moreover, the skill in the use of mobile phone was quantified by assessing familiarity and accuracy of phone operation and was investigated in the association with the fixation durations. We found that first fixation duration of the bottom left region is significantly negatively correlated with the smartphone operation level in the session 1, but there is no significant correlation between them in the session (2) According to the results of ratio exploration, the ratio of the first fixation duration to the total fixation duration is not significantly different between areas of interest for both sessions. The findings of this study provide insights into the attention allocation during browsing app interfaces and are of implications on the design of app interfaces and advertisements as layout can be optimized according to the attention allocation to maximally deliver information

On the Use of EEG or MEG Brain Imaging Tools in Neuromarketing Research

Here we present an overview of some published papers of interest for the marketing research employing electroencephalogram (EEG) and magnetoencephalogram (MEG) methods. The interest for these methodologies relies in their high-temporal resolution as opposed to the investigation of such problem with the functional Magnetic Resonance Imaging (fMRI) methodology, also largely used in the marketing research. In addition, EEG and MEG technologies have greatly improved their spatial resolution in the last decades with the introduction of advanced signal processing methodologies. By presenting data gathered through MEG and high resolution EEG we will show which kind of information it is possible to gather with these methodologies while the persons are watching marketing relevant stimuli. Such information will be related to the memorization and pleasantness related to such stimuli. We noted that temporal and frequency patterns of brain signals are able to provide possible descriptors conveying information about the cognitive and emotional processes in subjects observing commercial advertisements. These information could be unobtainable through common tools used in standard marketing research. We also show an example of how an EEG methodology could be used to analyze cultural differences between fruition of video commercials of carbonated beverages in Western and Eastern countries

The Dynamic EEG Microstates in Mental Rotation

Mental rotation is generally analyzed based on event-related potential (ERP) in a time domain with several characteristic electrodes, but neglects the whole spatial-temporal brain pattern in the cognitive process which may reflect the underlying cognitive mechanism. In this paper, we mainly proposed an approach based on microstates to examine the encoding of mental rotation from the spatial-temporal changes of EEG signals. In particular, we collected EEG data from 11 healthy subjects in a mental rotation cognitive task using 12 different stimulus pictures representing left and right hands at various rotational angles. We applied the microstate method to investigate the microstates conveyed by the event-related potential extracted from EEG data during mental rotation, and obtained four microstate modes (referred to as modes A, B, C, D, respectively). Subsequently, we defined several measures, including microstate sequences, topographical map, hemispheric lateralization, and duration of microstate, to characterize the dynamics of microstates during mental rotation. We observed that (1) the microstates sequence had a specified progressing mode, i.e., A → B → A ; (2) the activation of the right parietal occipital region was stronger than that of the left parietal occipital region according to the hemispheric lateralization of the microstates mode A; and (3) the duration of the second microstates mode A showed the shorter duration in the vertical stimuli, named “angle effect”

Investigating Driver Fatigue versus Alertness Using the Granger Causality Network

Driving fatigue has been identified as one of the main factors affecting drivers’ safety. The aim of this study was to analyze drivers’ different mental states, such as alertness and drowsiness, and find out a neurometric indicator able to detect drivers’ fatigue level in terms of brain networks. Twelve young, healthy subjects were recruited to take part in a driver fatigue experiment under different simulated driving conditions. The Electroencephalogram (EEG) signals of the subjects were recorded during the whole experiment and analyzed by using Granger-Causality-based brain effective networks. It was that the topology of the brain networks and the brain’s ability to integrate information changed when subjects shifted from the alert to the drowsy stage. In particular, there was a significant difference in terms of strength of Granger causality (GC) in the frequency domain and the properties of the brain effective network i.e., causal flow, global efficiency and characteristic path length between such conditions. Also, some changes were more significant over the frontal brain lobes for the alpha frequency band. These findings might be used to detect drivers’ fatigue levels, and as reference work for future studies